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SUMMARY 


A.  Problem 

Since  1964,  the  Strong  Vocational  Interest  Blank  (SVIB)  has  been  adminis 
tered  to  NROTC  (Regular)  scholarship  applicants.  Inasmuch  as  an  SVIB  scale 
is  used  in  selection  for  identifying  potential  career  effectiveness,  it  was 
essential  to  assess  this  scale's  fakability. 

B.  Background 


The  responses  of  several  groups  of  subjects  administered  the  SVIB  under 
a  variety  of  conditions  were  contrasted.  Under  instructions  to  do  so,  some 
individuals  can  increase  their  scores  by  faking.  However,  in  an  analysis 
of  retention  scale  scores  obtained  by  NROTC  applicants  retested  as  freshmen, 
no  significant  tendency  to  fake  emerged.  This  finding  indicated  that  either 
faking  does  not  occur  under  selection  conditions  or  that  faking  was  present 
in  both  the  selection  and  freshmen  administrations.  These  alternatives 
required  further  evaluation. 

C.  Approach 

Strong  Vocational  Interest  Blanks  taken  by  NROTC  applicants  as  part  of 
a  routine  non-Navy  testing  program  were  obtained  and  compared  with  those 
taken  under  actual  NROTC  selection  conditions.  The  results  of  this  analysis 
were  compared  with  those  obtained  from  the  previously  conducted  simulated 
faking  study. 

D.  Findings ,  Conclusions ,  Recommendations 

Previous  data  indicated  that  when  instructed  to  fake,  most  individuals 
can  increase  their  scores  on  the  selection  scale  to  some  extent.  However, 
comparison  of  applicant  and  routine  administrations  indicates  that  under 
actual  selection  conditions  there  is  neither  a  significant  nor  consistent 
tendency  for  applicants  to  increase  their  selection  scores.  (pages  2-6) 
These  results  suggest:  (1)  that  simulated  faking  designs  do  not  parallel 
what  occurs  in  selection;  instead,  they  provide  only  an  indication  of  how 
much  a  scale  can  be  faked,  and  (2)  faking  is  not  a  serious  problem  in  the 
use  of  the  SVIB  in  NROTC  selection. 
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AN  ASSESSMENT  OF  FAKING  ON  THE  STRONG  VOCATIONAL  INTEREST 
BLANK  UNDER  ACTUAL  SELECTION  CONDITIONS 


A.  PURPOSE 

Since  1964  a  considerable  amount  of  research  has  been  devoted  to  the  use 
of  the  Strong  Vocational  Interest  Blank  (SVIB)  as  an  instrument  for  early 
identification  of  high  tenure  Navy  officers.  The  primary  purpose  of  these 
efforts  has  been  to  develop  measures  to  use  in  the  selection  of  Navy  ROTC 
scholarship  applicants.  As  a  result  of  this  research,  a  scale  was  developed 
to  differentiate  between  high  and  low  tenure  officers  commissioned  from  the 
NROTC  program.  This  scale  provided  excellent  discrimination  between  the 
criterion  samples  on  which  the  key  was  constructed,  and  its  validity,  though 
somewhat  reduced,  remained  high  on  a  variety  of  cross-validation  samples. 

In  addition,  the  scale,  when  applied  to  groups  who  had  been  tested  as  high 
school  graduates  and  retested  8  to  10  years  later,  provided  very  satisfactory 
reliability. 

Despite  the  scale's  validity  and  reliability,  information  on  fakability 
is  essential  for  such  a  measure  before  it  may  be  recommended  for  use  in 
selection.  Several  studies  of  faking  (Garry,  1953;  Gehman,  1957;  Gray,  1959) 
indicate  that  when  instructed  to  fake  specific  SVIB  occupational  scales, 
individuals  can,  on  the  average,  increase  their  scores  by  1  to  5  standard 
deviations.  This  information  would  suggest  that  the  Strong  must  be  used  with 
caution,  if  at  all,  in  selection.  However,  in  virtually  all  published  studies 
of  faking  on  the  Strong,  the  subjects  have  been  instructed  to  fake  on  certain 
scales.  This  approach  provides  no  information  on  the  tendency  to  fake  in 
actual  selection  situations.  Therefore,  it  was  considered  essential  to  inves¬ 
tigate  the  fakability  of  the  retention  scale  under  such  conditions.  This 
report  summarizes  earlier  work  on  the  fakability  of  the  SVIB  retention  scale 
and  extends  the  research  to  faking  under  actual  selection  conditions. 


B.  BACKGROUND 

In  an  initial  attempt  to  ascertain  the  fakability  of  the  retention 
measure,  a  previous  investigation  (Abrahams,  Neumann,  §  Githens,  1968)  uti¬ 
lized  data  from  two  groups  of  individuals  on  whom  SVIB  test  and  retest  data 
were  collected.  The  first  group  consisted  of  122  Officer  Candidate  School 
(OCS)  trainees  who  had  taken  "honest"  and  "faked"  SVIB's  under  experimental 
testing  conditions.  In  the  "faking"  administration  subjects  were  instructed 
to  respond  as  they  thought  career  Navy  Officers  would.  Results  for  this 
group  indicated,  quite  dramatically,  that  OCS  trainees  could  improve  their 
officer  retention  scale  score  considerably  when  instructed  to  respond  as  a 
career  officer  would.  On  the  average,  scores  were  increased  by  three-fourths 
of  a  standard  deviation.  This  information,  if  taken  alone,  might  advise 
against  using  the  retention  scale  as  a  selection  instrument.  Again,  though 
it  must  be  pointed  out  that  these  results  are  based  on  instructions  to  fake-- 
not  on  actual  selection  conditions.  Consequently,  those  data  indicate  only 
that  the  retention  scale  can  be  faked--not  that  it  will  be  faked. 
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The  second  group  used  in  the  previous  study  was  analyzed  in  an  attempt 
to  determine  the  magnitude  of  faking  under  actual  selection  conditions.  This 
group  consisted  of  249  NROTC  scholarship  winners  who  as  part  of  the  selection 
process  had  completed  the  SVIB.  Approximately  one  year  later,  as  freshmen, 
these  students  were  retested  at  their  NROTC  units  under  experimental  testing 
conditions  where,  presumably,  there  would  be  little  motivation  to  fake.  A 
comparison  of  their  applicant  and  retest  means  revealed  virtually  no  dif¬ 
ferences.  The  correlation  between  the  scores  on  the  two  administrations  was 
.67  and  the  percentage  overlap  between  the  score  distributions  was  97.  These 
results  are  in  stark  contrast  to  the  data  based  on  the  instructionally  faked 
SVIB's  where  the  test-retest  correlation  was  .18  and  percentage  overlap 
between  score  distribution  was  only  70.  These  data  indicate  that  either 
faking  does  not  occur  under  selection  conditions  or  that  the  perceived  need 
to  fake  was  present  in  both  the  selection  and  freshmen  administration. 

To  evaluate  these  alternatives  further,  SVIB  testing  conditions  should 
be  arranged  so  that  NROTC  applicants  would  answer  the  SVIB  under  NROTC 
selection  conditions  and  under  conditions  having  no  connection  with  the 
Navy.  The  purpose  of  the  present  study  is  to  analyze  SVIB's  administered  in 
this  manner  and  compare  the  results  with  those  of  the  previous  study.  In 
the  present  study,  selection  SVIB's  and  SVIB's  administered  as  part  of 
routine  high  school  and  college  testing  programs  were  gathered  for  102 
applicants.  Results  under  selection  and  routine  testings  are  compared  with 
specific  emphasis  on  retention  scale  scores.  The  data  are  also  contrasted 
with  those  obtained  under  simulated-faking  conditions.  These  comparisons 
are  primarily  intended  to  determine  whether  the  retention  scale  is  actually 
faked  under  operational  selection  conditions,  and  secondarily  to  compare  the 
extent  of  faking  under  real-life  motivation  and  instructions  to  fake. 


C.  PROCEDURE  AND  RESULTS 


The  high  school  and  college  records  of  NROTC  scholarship  applicants  in 
1965,  1966,  and  1967  were  examined  to  locate  those  applicants  who  had  taken 
the  SVIB  under  routine  testing  conditions.  A  total  of  102  such  individuals 
was  located;  46  had  completed  the  SVIB  in  high  school  prior  to  the  NROTC 
administration  and  56  had  taken  it  in  college  following  NROTC  selection. 

For  the  latter  group,  selection  or  rejection  for  the  NROTC  scholarship--either 
by  the  Navy  or  the  applicant  himself--occurred  between  the  selection  and  the 
routinely  administered  college  SVIB.  Since  this  intervening  experience 
could  lead  to  real  changes  in  interests  and  thus  be  confounded  with  tendencies 
toward  faking,  results  for  the  groups  are  analyzed  separately. 

Comparison  of  the  selection  and  the  high  school  testing  scores  for  the 
first  group  on  the  standard  occupational  scales  shows  marked  similarity. 

These  mean  profiles  shown  in  Figure  1  are  as  similar  to  one  another  as  are 
standard  test-retest  groups  reported  in  the  SVIB  manual  (Campbell,  1966). 

The  rank-order  correlation  between  these  mean  profiles  is  .95.  Since  faking 
on  any  one  scale  typically  influences  scores  on  other  scales  (e.g..  Gray, 
1959),  this  comparison  would  support  the  conclusion  that  the  applicants  did 
not  fake. 
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PROFILE  FOR  STRONG  VOCATIONAL  INTEREST  BLANK  -  FOR  MEN 


Figure  1.  Mean  SVIB  profiles  for  NROTC  selection  and  routine  high  school 
testing  administrations  (N=46) . 
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For  this  same  group,  Table  1  provides  means  and  standard  deviations  on 
the  retention  scale.  These  data  clearly  indicate  a  lack  of  faking  as  measured 
by  the  retention  scale.  The  correlation  between  retention  scale  scores 
obtained  on  the  two  administrations  is  .79  and  the  percentage  overlap  between 
score  distributions  is  97.  A  test-retest  correlation  of  this  magnitude 
matches  that  obtained  on  SVIB  occupational  scales  from  standard  testing 
conditions  over  a  similar  time  period  (Johansonn,  1968).  Furthermore,  the 
test-retest  correlation  differs  considerably  from  the  .18  obtained  when 
individuals  were  first  tested  under  usual  instructions  and  then  were  retested 
with  instructions  to  fake. 


TABLE  1 

Comparison  of  SVIB  Retention  Scale  Scores  Obtained  Under  NROTC 
Selection  and  Routine  High  School  Testing  Conditions 


Administration 

N 

X 

S.D. 

Percentage 

Overlap 

Test-Retest 

r 

NROTC  Selection 

46 

103.54 

10.99 

97 

.79 

Routine  High  School 

46 

102.67 

11.53 

A  similar  analysis  was  conducted  on  those  applicants  who  had  taken  the 
SVIB  for  NROTC  application  and  who  later  took  the  SVIB  as  part  of  routine 
college  testing.  These  were  considered  as  a  separate  sample  due  to  the 
possibility  of  a  real  change  in  interests  as  a  result  of  their  rejection  or 
selection  for  the  NROTC  scholarship.  Occupational  profiles  for  both  selec¬ 
tion  and  routine  testing  SVIB  administrations  were  prepared.  These  data, 
shown  in  Figure  2, reveal  virtually  identical  mean  profiles.  The  correlation 
between  these  profiles  is  .98.  Table  2  presents  the  retention  scale  means 
and  standard  deviations  obtained  under  both  administrations.  While  the 
scores  of  the  routine  and  selection  administrations  are  not  as  similar  to 
each  other  as  those  in  the  previous  sample,  the  percentage  overlap  of  87  and 
test-retest  correlation  of  .71  still  indicate  considerable  similarity. 

Although  there  is  a  slight  but  not  significant  (p=.33,  one-tail)  advan¬ 
tage  for  the  selection  administration,  it  does  not  approach  the  amount  of 
change--either  in  terms  of  correlation  or  percentage  overlap  between  score 
distributions--found  in  the  simulated  faking  group.  As  suggested  earlier, 
a  change  between  the  selection  and  subsequent  routine  administration  scores 
may  signify  a  genuine  shifting  of  interests  for  those  applicants  who  were 
rejected.  In  fact,  there  is  some  empirical  support  for  this  notion.  For 
those  on  whom  selection  or  rejection  status  information  could  be  located, 
the  test  and  retest  means  were  computed.  While  no  tests  of  significance 
have  been  made,  the  trend  seems  to  support  the  suggestion  that  the  rejectees 
reduce  their  retest  scores  on  the  retention  scale  more  than  selectees  do. 
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PROFILE  FOR  STRONG  VOCATIONAL  INTEREST  BLANK  -  FOR  MEN 


|  Std. 

1  ^  1 

n  1 

1  1 

Occupation 

1 

Score 

c 

1  C+  1 

B-l  B 

1  B+  1 

A 

Naval  Officer  Scale 


Physical  Therapist 


Dentist 


Osteopath 


Veterinarian 


Physician 


Psychiatrist 


Psychologist 


Biologist 


Architect 


Mathematician 


Physicist 


Chemist 


Engineer 


Production  Manager 


Army  Officer  _ 


Air  Force  Officer 


Carpenter 


Forest  Service 


Farmer 


Math-Scienc'e  Teacher 


Printer 


Policeman 


Personnel  Director 


Public  Administrator 


Rehabilitation  Couns. 


YMCA  Secretary 


Recreation  Admin. 


Social  Worker 


Social  Science  Teacher 


School  Superintendent 


Minister 


Librari  an 


Artist 


Music  Performer 


Music  Teacher 


CPA  Owner 


Senior  CPA 


Accountant 


Office  Worker 


Credit  Manager 


Chamber  of  Commerce 


Bus.  Educ.  Teacher 


Purchasing  Agent 


Banker 


Pharmacist 


Mortician 


Sales  Manager 


Real  Estate  Salesman 


Life  Insurance  Sales 


Advertising  Man 


Attorney 


Author-Journalist 


Pres . -Mf 


Interpreter 


7  n 


Administration: 


College 

NROTC 


Figure  2.  Mean  SVIB  profiles  for  NROTC  selection  and  routine  college 
testing  administrations  (N=56) . 
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TABLE  2 


Comparison  of  SVIB  Retention  Scale  Scores  Obtained  Under 
NROTC  Selection  and  Routine  College  Testing  Conditions 


Administration 

N 

X 

S.D. 

Percentage 

Overlap 

Test-Retest 

r 

NROTC  Selection 

56 

102.77 

11.03 

87 

.71 

Routine  College 

56 

98.91 

11.88 

For  purposes  of  comparing  changes  on  SVIB  occupational  scale  scores 
obtained  on  the  actual  selection  and  routine  testing  with  those  obtained  in 
the  simulated  faking  study,  mean  profiles  were  prepared  for  both  the  "honest" 
and  the  "faked"  conditions.  Inspection  of  those  profiles  for  score  shifts 
of  at  least  one-half  of  a  standard  deviation  on  the  55  occupational  scales 
revealed  30  such  changes.  Several  easily  discernible  vocational  content 
themes  emerge  from  these  differences.  When  instructed  to  fake,  occupational 
scales  reflecting  business  management,  leadership,  and  military  content 
increase  and  scales  reflecting  scientific,  verbal,  and  artistic  occupations 
decrease . 

Inspection  of  the  differences  between  the  selection  and  routine  testing 
profiles  indicated  no  shifts  of  this  magnitude  for  those  retested  as  freshmen, 
and  only  three  for  those  routinely  tested  in  high  school.  The  rank-order 
correlation  between  the  "fake"  and  "honest"  mean  profiles  is  only  .78, compared 
with  the  selection  and  routine  mean  profile  correlations  of  .95  and  .98. 


CONCLUSIONS  AND  RECOMMENDATIONS 


The  data  from  these  studies  indicate  that,  when  instructed  to  do  so,  most 
individuals  can  increase  their  scores  on  an  SVIB  retention  scale.  However, 
comparison  of  selection  and  routine  SVIB  administrations  indicates  that  under 
actual  selection  conditions  there  is  neither  a  significant  nor  consistent 
tendency  for  applicants  to  increase  their  selection  scores.  To  the  extent 
that  these  findings  are  generalizable  to  other  SVIB  scales,  there  would  seem 
to  be  little  parallel  between  test-taking  behavior  under  faking  instructions 
and  under  actual  selection  conditions.  It  may  be  concluded,  therefore,  that 
simulated  faking  designs  do  not  provide  a  particularly  appropriate  estimate 
of  what  occurs  in  selection,  instead  they  provide  only  an  indication  of  how 
much  a  scale  can  be  faked.  Thus,  it  is  recommended  that  simulated  faking 
studies  not  be  considered  to  provide  conclusive  evidence  of  the  extent  to 
which  faking  is  likely  to  occur  in  actual  selection  settings.  With  respect 
to  NROTC  selection,  all  available  evidence  indicates  that  faking  does  not 
appear  to  be  a  serious  problem  and  the  continued  use  of  the  SVIB  retention 
scale  is  recommended. 
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